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ABSTRACT 

Objective: To validate the utilities of Berlin, STOP 
and STOP-BANG Questionnaires, other patient 
characteristics, comorbidities, Epworth Sleepiness 
Scale (ESS), fractional exhaled nitric oxide (F E N0) and 
blood markers for the prediction of sleep disordered 
breathing (SDB) on limited polygraphy. 
Setting: North Glasgow Sleep Service (a tertiary 
referral centre). 

Participants: 129 consecutive patients, aged 
>1 6 years, referred to the sleep clinic for assessment 
of possible obstructive sleep apnoea. 
Interventions: We selected cut-points of apnoea 
hypopnoea index (AHI) of >5 and >15/h from their 
home polygraphy and determined associations of these 
with individual symptoms, questionnaire scores and 
other results. Receiver operating characteristic analysis 
and univariate and multivariate logistic regression were 
used to explore these. 

Primary and secondary outcomes measures: 

Primary. The utility of STOP, STOP-BANG and Berlin 
Questionnaires for prediction of SDB. Secondary. 
The utility of other measures for prediction of SDB. 
Results: AHI was >5 in 97 patients and >15 in 
56 patients. STOP and STOP-BANG scores were 
associated with both AHI cut-points but results with 
ESS and Berlin Questionnaire scores were negative. 
STOP-BANG had a negative predictive value 1.00 
(0.77-1.00) for an AHI >15 with a score >3 predicting 
AHI >5 with sensitivity 0.93 (95% CI 0.84 to 0.98) and 
accuracy 79%, while a score >6 predicted AHI >15 
with specificity 0.78 (0.65 to 0.88) and accuracy 72%. 
Neck circumference >17 inch and presence of 
witnessed apnoeas were independent predictors of 
SDB. 

Conclusions: STOP and STOP-BANG Questionnaires 
have utility for the prediction of SDB in the sleep clinic 
population. Modification of the STOP-BANG 
Questionnaire merits further study in this and other 
patient groups. 
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INTRODUCTION 

Obstructive sleep apnoea syndrome (OSAS) 
is common with prevalence of approximately 
4% in middle-aged men and 2% in middle- 
aged women. 1 Frequent partial (hypopnoea) 
or complete (apnoea) upper airway collapse 



Strengths and limitations of this study 



■ This is the first study to prospectively evaluate 
the utility of the Berlin, STOP and STOP-BANG 
Questionnaires in the prediction of sleep disor- 
dered breathing in the population referred to a 
sleep service for assessment of possible 
obstructive sleep apnoea (OSA). 

■ The results of this study show that the STOP and 
STOP-BANG, but not the Berlin Questionnaire, 
have utility for prediction of sleep disordered 
breathing in the sleep clinic population. 

■ This study uses home unattended limited sleep 
studies rather than in-hospital attended full poly- 
somnography; however, this is considered stand- 
ard clinical practice in the UK and is considered 
an acceptable method for diagnosis of OSA by 
the American Academy of Sleep Medicine. 

■ The sample size limits the conclusions that can 
be drawn from the multivariate analysis; 
however, this was a secondary objective of the 
study. 



during sleep leads to oxygen desaturation, 
increased respiratory effort, arousal and sleep 
fragmentation. 2 Patients typically present with 
witnessed apnoeas, loud snoring and exces- 
sive daytime somnolence. 3 The syndrome is 
associated with impaired quality of life, 4 cog- 
nitive functioning and work performance, 5 
and with increased risk of road traffic acci- 
dents. 6 OSAS is considered an independent 
risk factor for hypertension, 7 and has associa- 
tions with coronary disease, stroke, heart 
failure, arrhythmias, 8 metabolic syndrome 9 
and type 2 diabetes. 10 

Despite the substantial burden of this 
disease, it is under-recognised. One study 
estimated that 93% of women and 82% of 
men with moderate-to-severe OSAS were not 
clinically diagnosed, 11 and more recent data 
support this finding. 12 Sleep studies are 
required for OSAS diagnosis but are expen- 
sive and not widely available. 3 Given the 
recent increases in childhood 13 and adult- 
hood obesity, 14 the workload for sleep clinics 



Cowan DC, Allardice G, MacFarlane D, etal. BMJ Open 2014;4:e004519. doi:1 0.1 1 36/bmjopen-201 3-00451 9 



1 



Open Access 



and sleep laboratories will increase. Predictors of sleep 
disordered breathing (SDB) are required to allow recog- 
nition of OSAS and priori tisation of investigations. 

Several questionnaires have been designed to screen 
for SDB in different populations. The Berlin 
Questionnaire was first validated in primary care against 
portable unattended sleep studies and a 'high risk' score 
predicted a respiratory disturbance index >5 with sensitiv- 
ity 0.86, specificity 0.77, positive predictive value (PPV) 
0.89 and likelihood ratio 3.79. 15 Its utilisation in other 
populations has been assessed with variable success. 16-22 
The STOP and STOP-BANG Questionnaires were origin- 
ally validated in surgical patients using in-hospital 
attended polysomnography. 23 For prediction of apnoea 
hypopnoea index (AHI) greater than 5, 15 and 30, sensi- 
tivities for the STOP and STOP-BANG Questionnaires 
were 65.6%, 74.3% and 79.5%, and 83.9%, 92.9% and 
100%, respectively. The Berlin and STOP Questionnaires 
have been compared in a cohort of surgical patients 24 
and the STOP and STOP-BANG Questionnaires have 
been compared in a large study involving several distinct 
cardiovascular and respiratory disease cohorts. 25 No study 
has, however, compared these screening tools in a sleep 
service-referred population. Finally, because of rising 
obesity rates, there is the potential for increasing recogni- 
tion of SDB in primary care, and in the face of this evolu- 
tion in sleep clinic practice it is therefore necessary to 
update and re-evaluate established assessment tools. 

The objective of this study was, first, to compare the 
utility of Berlin, STOP and STOP-BANG Questionnaires 
for prediction of SDB in a population referred to the 
sleep clinic for assessment of possible OSA. Second, we 
sought to identify the most important variables from 
these questionnaires and routine sleep clinic assessment 
that might be utilised in the development of a compos- 
ite predictive score for future use in this population. 

METHODS 

This was a prospective observational study conducted 
during May-December 2012. Study participants received 
an information sheet and provided informed consent. 

Participants 

Consecutive patients aged >1 6 years referred to the 
North Glasgow Sleep Service (a tertiary centre) for 
assessment of possible OSA were invited to participate. 

Measurements 

Height, weight, body mass index (BMI), neck circumfer- 
ence, blood pressure and Epworth Sleepiness Scale 
(ESS) 26 were completed at the Sleep Clinic. Participants 
attended the Sleep Laboratory on a separate day so that 
a Sleep Physiologist could provide, and instruct on 
fitting, a sleep study device. On that occasion, relevant 
symptoms and comorbidities were recorded, Mallampati 
score was assessed and the Berlin and STOP-BANG 
Questionnaires were completed. Blood samples 



including a non-fasting lipid profile, glycated haemoglo- 
bin (HbAlc) and C reactive protein were taken. Two 
fractional exhaled nitric oxide (F E NO) measurements 
were taken using the NIOX MINO (Aerocrine, Solna, 
Sweden), and the mean calculated. 

Sleep studies 

Unattended home limited polygraphy sleep studies were 
performed using the SOMNOmedics SOMNOscreen kit 
(Randersacker , Germany) with channels that recorded 
body position, thoracoabdominal movements, oronasal 
airflow, heart rate, pulse oximetry and snoring. Sleep 
study scoring by experienced Sleep Physiologists was in 
accordance with accepted guidelines. 27 An apnoea was 
defined as cessation of nasal flow for >10 s, while a 
hypnoea was defined as 50% reduction in nasal flow for 
>10 s, or lesser reduction in flow associated with oxygen 
desaturation of >4%. 

The ESS, Berlin, STOP and STOP-BANG Questionnaires 

The ESS is a validated measure of daytime sleepiness 
including eight questions, each with four possible 
responses, that assess the likelihood of dozing in different 
situations; a score of >ll/24 denotes excessive daytime 
somnolence. 26 The Berlin Questionnaire includes ques- 
tions in three categories that relate, first, to snoring and 
witnessed apnoeas, second, to tiredness, fatigue and 
sleepiness, and third, to hypertension and obesity. 15 High 
risk of OSA is defined by scoring positively in >2 categor- 
ies. The STOP Questionnaire includes four yes/no ques- 
tions that relate to Snoring, Tiredness, Observed apnoeas 
and high blood Pressure. 23 High risk of OSA is defined as 
a score of >2. The STOP-BANG Questionnaire includes 
four additional questions relating to BMI, age, neck cir- 
cumference and gender, and high risk of OSA is defined 
as a score of >3. 23 

Statistical analyses 

Statistical analyses were carried out using GraphPad 
Prism 5, IBM SPSS Statistics V.19 and STATA V.12. 
Normality of data was checked using the D'Agostino & 
Pearson omnibus normality test. A priori, two cut-points 
were chosen for AHI >5 events/h (the standard cut- 
point for the diagnosis of OSA) 28 and >15 events/h, to 
predict significant SDB (the standard cut-point for initi- 
ating continuous positive airway pressure (CPAP) 
therapy). 28 Groups were compared using unpaired 
t tests, Mann-Whitney tests and Fisher's exact tests as 
appropriate. Sensitivities, specificities, PPV and negative 
predictive value (NPV), positive and negative likelihood 
ratios and overall accuracies were calculated for each of 
the questionnaires for prediction of SDB as defined by 
AHI cut-points >5 and >15. Associations between indi- 
vidual variables and each of the cut-points for AHI were 
explored using univariate and multivariate logistic 
regression. For multivariate analysis, in a few cases where 
BMI was known but neck circumference was not known, 
a value for the neck circumference was imputed using 
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linear regression with BMI as the independent value. 
This allowed for a dataset of 116 cases with all of the 
variables known or imputed to be built to identify inde- 
pendent variables for inclusion in a composite score. 
Receiver operating characteristic (ROC) curve analysis 
was used to assess predictive value and an area under 
the curve (AUC) >0.7 was considered clinically signifi- 
cant. Data are presented as mean (SD), median (IQR) 
and proportion (percentage), unless stated otherwise. 
A p value <0.05 was considered statistically significant. 

RESULTS 

In total 150 participants participated in this study, of 
which 129 had adequate sleep study data and were 
included in the analysis. AHI was >5 in 97/129 (75%) 
and >15 in 56/129 (43%). Overall, 82 (64%) were male, 
mean (SD) age was 49 (11) years, and median (IQR) 
BMI was 32 (29-39) kg/m 2 . 

Predicting SDB: patient characteristics 

An AHI <5 ('rule-out measurement') was associated with 
female sex, younger age, lower weight and neck circum- 
ference, less frequently reported witnessed apnoeas, 
higher high-density lipoprotein (HDL) cholesterol, and 
lower triglycerides, cholesterol/HDL and HbAlc (see 
table 1). An AHI >15 ('rule-in measurement') was asso- 
ciated with male sex, obesity, higher weight, BMI and 
neck circumference, more frequently reported hyperten- 
sion and witnessed apnoeas, lower HDL cholesterol, and 
higher triglycerides, cholesterol/HDL and HbAlc. 

Predicting SDB: ESS, Berlin, STOP and STOP-BANG 

The ESS and Berlin questionnaire outcomes were not 
associated with either AHI cut-point. An AHI <5 was 
associated with lower STOP and STOP-BANG scores and 
fewer participants being classified as 'high risk' for OSA 
by both STOP and STOP-BANG Questionnaires (see 
tables 2-4). An AHI >15 was associated with higher 
STOP and STOP-BANG scores and more participants 
being classified as 'high risk' for OSA by the 
STOP-BANG Questionnaire but not by the STOP 
questionnaire. 

For the AHI cut-point of >5, the Berlin, STOP and 
STOP-BANG Questionnaires had high sensitivities, mod- 
erate PPVs and poor specificities and NPVs for predic- 
tion of SDB. The STOP-BANG Questionnaire 
performed best with an overall accuracy of 79%. For the 
AHI cut-point of >15, the Berlin Questionnaire had 
high sensitivity but otherwise performed poorly. The 
STOP and STOP-BANG Questionnaires had high sensi- 
tivities and NPVs. Again, the STOP-BANG Questionnaire 
performed best, but with a low overall accuracy of 56%. 
The low negative likelihood ratios for the STOP and 
STOP-BANG Questionnaires at both cut-points indicate 
that these questionnaires have value in excluding 
disease. As shown in table 4, the cut-points for the 
STOP-BANG score that was associated with best overall 



accuracy were >3 and >6 for prediction of AHI >5 and 
>15, respectively. 

SDB versus no SDB: predictors and a composite score 

For the cut-point of AHI of >5, univariate logistic regres- 
sion showed significant associations for age, gender, 
weight, neck circumference, witnessed apnoeas, trigly- 
cerides and cholesterol/HDL (p<0.05; see tables 5 and 
6 and figure 1). For the cut-point of >15, significant 
associations were found for gender, weight, BMI, neck 
circumference, witnessed apnoeas, obesity, hypertension, 
F E NO and cholesterol/HDL (p<0.05). Multivariate logis- 
tic regression based on the significant variables from 
univariate logistic regression showed that for both cut- 
points neck circumference and witnessed apnoeas were 
independent predictors of SDB. For the cut-point of 
AHI of >5, in a model incorporating neck circumfer- 
ence and witnessed apnoeas, the probability of SDB was 
0.94 for individuals with neck circumference >l7inch 
and witnessed apnoeas (sensitivity 84%, overall accuracy 
77%, ROC AUC 0.768, p<0.001). For the cut-point of 
AHI >15, the probability of SDB was 0.69 for individuals 
with neck circumference >l7inch and witnessed 
apnoeas (specificity 80%, overall accuracy 69%, ROC 
AUC 0.722, p<0.001). 

DISCUSSION 

This is the first study to prospectively evaluate the utility 
of the Berlin, STOP and STOP-BANG Questionnaires in 
prediction of SDB in a population referred to a tertiary 
sleep service for assessment of possible OSA. We found 
that in this population the Berlin Questionnaire had no 
significant association with cut-points of >5 or >15 for 
AHI, but that both the STOP and STOP-BANG scores 
were significantly associated with both cut-points. The 
STOP-BANG Questionnaire had better performance for 
the prediction of OSA on home sleep study, and differ- 
ent cut-points for the STOP-BANG score could be 
selected depending on the preference to exclude SDB 
(score <3) or predict SDB (score >6). In addition, we 
found notable associations between sleep study results 
and several patient characteristics. In particular, neck cir- 
cumference and witnessed apnoeas were found to be 
independent predictors of SDB in our population. 

In our study, the Berlin Questionnaire was almost ubi- 
quitously positive (116 of 125 participants had a positive 
result) and the positivity rate did not differ between 
those with and without SDB. This was expected as this 
questionnaire was designed for primary care assessment 
and our study population consisted of individuals 
referred from primary care with symptoms suggestive of 
SDB. Our results indicate that the Berlin Questionnaire 
is not useful in the prediction of SDB in the sleep clinic 
referral population and this is consistent with previous 
reports. 19 The high sensitivities obtained for both AHI 
cut-points support previous findings that the Berlin 
Questionnaire may have a role as a 'rule-out' 
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Table 1 Comparison of patient characteristics including anthropometric measurements, comorbidities, symptoms, 
inflammatory markers, lipid profile and oximetry between groups without and with SDB as defined by AHI <5 and >15 events/h 





AHI <5 


AHI >5 


p Value 


AHI <15 


AHI >15 


p Value 


Male gender 


i C/QO / A~70/ \ 
\0/oZ (4/ /o) 


67/97 


(69%) 


n HQA 


38/73 


(52%) 


44/56 


(79%) 


o OOO 

U.UUd 


Age (years) 


A A I i 0\ 

44 ( 12) 


57 


(11) 


U.UU4 


48 


(13) 


51 


(9) 


U.I Uo 


vveignT (Kg; 


on / 1 o\ 
ob) ( lb)) 


707 


(22) 


U.U22 


92 


(21) 


707 


(20) 


U.UUI 


bMi (kg/m ) 


OH /OO OC\ 

ol (2o—3b) 


33 


(29-40) 


0.1 1o 


31 


(27-36) 


34 


(31-41) 


O OOO 

0.009 


uoesity (bivii >oU Kg/m ) 


A O /OO Id. AO/ \ 

\ol2o (b47o) 


61/85 


(72%) 


r\ a oo 
\jAo2 


38/63 


(60%) 


41/50 


(82%) 


n o -i a 


Neck circumference (inch) 


75(2; 


77 


(2) 


<U.UUl 


16 


(2) 


17 


(V 


<U.UUl 


Neck circumference >17 inch 


// /OO / ■/ OO/ I 

4/22 ( 70%; 


45/76 


(59%) 


U.UUI 


18/54 


(33%) 


31/44 


(70%) 


^.O OO -i 

<U.UUl 


Mallampati 


2 (1) 


2 


(1) 


U.I V2. 


2 


0) 


2 


(1) 


O QOO 

u.yuu 


ODD /rv>r« I_Ian\ 

bbr (mm rig) 


H O A /H "7\ 

1o4 (17) 


136 


(16) 


n a on 


134 


(15) 


138 


(18) 


O H O/l 

U.iy4 


ubr (mm ng) 


OO /H H \ 

82 (11) 


83 


(9) 


r\ coo 
U.o2o 


81 


(10) 


85 


(10) 


o noc 
U.Uob 


Diabetes 


O /OO /CO/ \ 

2.162. (b%) 


6/97 


(6%) 


1 .000 


4/73 


(5%) 


4/56 


(7%) 


O "70"7 

0.727 


Hypertension 


"7/00 /OOO/ \ 

7/32 (22%) 


36/97 


(37%) 


O H OA 

0.1 o4 


78/73 


(25%) 


25/56 


(45%) 


O OO A 

0.024 


Hyperlipidaemia 


O/QO /CO/ \ 

2/o2 (D /o) 


18/97 


(19%) 


U.I oo 


10/73 


(14%) 


10/56 


(18%) 


U.D^lO 


Loud snorer 


OQ/QO /QQO/ \ 

2o/o2 (ooTo) 


92/97 


(95%) 


o OO/I 


65/73 


(89%) 


55/56 


(98%) 


U.U/ / 


Witnessed apnoeas 


■Y ZT/OO / A~70/ \ 

lo/o2 (47%) 


72/97 


(74%) 


O OOO 

U.UUO 


40/73 


(55%) 


47/56 


(84%) 


^O OO ■/ 

<U.UUl 


Nocturia* 


1 1/o2 (o4 /o) 


38/97 


(39%) 


u.D/ y 


26/73 


(36%) 


23/56 


(41%) 


U.ooo 


Nocturnal wakenings* 


H o/oo /coo/ \ 
1o/o2 (OD%) 


65/97 


(67%) 


O OOO 


46/73 


(63%) 


37/56 


(66%) 


O OCO 

0.o5v3 


Nocturnal choking 


i C/QO //l "70/ \ 

1iD/o2 (4/ /o) 


35/97 


(36%) 


U.oUl 


28/73 


(38%) 


22/56 


(39%) 


H OOO 

1 .uuu 


iNiuuiui i icti ydbpuiy 


I MOc. yO^t /o) 


38/97 


(39%) 


u.o / y 


26/73 


(36%) 


23/56 


(41%) 


u.ooo 


F E NO (ppb) 


15 (12-25) 


18 


(12-26) 


0.595 


15 


(11-24) 


19 


(12-27) 


0.050 


Cholesterol (mmol/L) 


5.2 (1.1) 


5.4 


(1.0) 


0.431 


5.3 


(1.1) 


5.4 


(0.9) 


0.674 


HDL cholesterol (mmol/L) 


1.3(1.0-1.5) 


7.7 


(1.0-1.3) 


0.008 


1.2 


(1.0-1.4) 


7.7 


(1.0-1.2) 


0.016 


Triglycerides (mmol/L) 


1.9(1.0-2.5) 


2.2 


(1.5-3.2) 


0.015 


1.9 


(1.3-2.9) 


2.3 


(1.6-3.2) 


0.042 


Cholesterol/HDL 


4.1 (3.3-5.0) 


4.7 


(3.8-5.7) 


0.011 


4.3 


(3.5-5.6) 


4.8 


(4.0-5.8) 


0.022 


HbA1c (mmol/mol) 


34 (32-37) 


38 


(36-41) 


0.001 


36 


(33-39) 


38 


(36-42) 


0.002 


CRP 


3.0 (1.2-8.5) 


3.8 


(1 .4-7.5) 


0.608 


3.0 


(1.3-7.6) 


4.3 


(1 .4-8.6) 


0.173 



Data presented as mean (SD), median (IQR) or proportion (percentage) as appropriate. Significant differences in italics. 
*>2/Night. 

AHI, apnoea hypopnoea index; BMI, body mass index; CRP, C reactive protein; DBP, diastolic blood pressure; F E NO, fraction of exhaled nitric 
oxide; HbA1c, glycated haemoglobin; HDL, high-density lipoprotein; ODI, oxygen desaturation index; SBP, systolic blood pressure; SDB, 
sleep disordered breathing. 



measurement in the primary care or screening 
setting, 15 17 20 24 though there have been some conflict- 
ing results, suggesting that it does not have adequate dis- 

16 22 

criminatory power. 

In our study, ESS data indicated that two-thirds of par- 
ticipants had excessive daytime somnolence (ESS >11); 
however, scores were similar in individuals with or 
without SDB. Therefore, at least in the sleep clinic popu- 
lation, the ESS is not useful for the prediction of SDB. It 



may be of value perhaps if it is combined with other 
measures, including those highlighted in this study, in 
prediction of compliance with and benefit from OSA 
treatment. Further research is required to address this 
question. The exhaled nitric oxide levels were not sig- 
nificantly different between individuals with or without 
SDB, whether defined by an AHI cut-point of >5 or 
>15. There are conflicting data in the literature regard- 
ing whether F E NO is associated with SDB; 29-32 however, 



Table 2 Comparison of results of ESS and Berlin, STOP and STOP-BANG Questionnaires between groups without and with 
SDB as defined by AHI <5 and >15 events/h 





AHI <5 


AHI >5 


p Value 


AHI <15 


AHI >15 


p Value 


ESS score 


13 (8-16) 


13(7-17) 


0.845 


13 (7-16) 


13(9-18) 


0.476 


ESS positive (> 11/24) 


17/28 (61%) 


63/92 (68%) 


0.496 


42/66 (64%) 


38/54 (70%) 


0.560 


Berlin positive 


29/31 (94%) 


87/94 (93%) 


1.000 


65/71 (92%) 


51/54 (94%) 


0.731 


STOP score 


2.5 (2-3) 


3 (2-3) 


0.011 


3 (2-3) 


3 (3-3.5) 


<0.001 


STOP positive (>2/4) 


27/32 (84%) 


93/96 (97%) 


0.023 


66/73 (90%) 


54/55 (98%) 


0.137 


STOP-BANG score 


4(2-5) 


5 (5-6) 


<0.001 


5(2-5) 


6 (5-6) 


<0.001 


STOP-BANG positive (>3/8) 


21/30(70%) 


88/93 (95%) 


<0.001 


54/68(79%) 


55/55(100%) 


<0.001 



Data presented as median (IQR) 
ESS, Epworth Sleepiness Scale; 



or proportion (percentage) as appropriate. 
SDB, sleep disordered breathing. 



Significant differences in italics. 
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Table 3 Sensitivities, specificities, PPV, NPV, LR+, LR- and overall accuracies of the Berlin, STOP and STOP-BANG 
Questionnaires for prediction of significant SDB as defined by: model A: AHI >5 events/h; model B: >15 events/h 

Accuracy 

Sensitivity Specificity PPV NPV LR+ LR- (%) 

Model A 

Berlin 0.93 (0.85 to 0.97) 0.06 (0.01 to 0.21) 0.75 (0.66 to 0.83) 0.22 (0.03 to 0.60) 0.99 1.15 71 

STOP 0.97 (0.91 to 0.99) 0.16 (0.05 to 0.33) 0.78 (0.69 to 0.85) 0.62 (0.24 to 0.91) 1.15 0.20 77 

STOP-BANG 0.95 (0.88 to 0.98) 0.30 (0.15 to 0.49) 0.81 (0.72 to 0.88) 0.64 (0.35 to 0.87) 1 .35 0.18 79 
Model B 

Berlin 0.94 (0.85 to 0.99) 0.08 (0.03 to 0.17) 0.44 (0.35 to 0.53) 0.67 (0.30 to 0.92) 1 .03 0.66 46 

STOP 0.98 (0.90 to 1 .00) 0.10 (0.04 to 0.19) 0.45 (0.36 to 0.54) 0.88 (0.47 to 1 .00) 1.09 0.19 48 

STOP-BANG 1 .00 (0.94 to 1 .00) 0.21 (0.12 to 0.32) 0.50 (0.41 to 0.60) 1 .00 (0.77 to 1 .00) 1 .26 0.00 56 



Data presented with 95% CIs. 

AHI, apnoea hypopnoea index; LR+, likelihood ratios positive; LR-, likelihood ratios negative; NPV, negative predictive values; PPV, positive 
predictive values; SDB, sleep disordered breathing. 



our results suggest that it does not have utility in predic- 
tion of SDB; further work is required to clarify this. 

We found that the STOP and STOP-BANG 
Questionnaires have utility in the prediction of SDB in 
the sleep clinic population, and that STOP-BANG was 
superior, with higher overall predictive accuracy. The 
STOP and STOP-BANG Questionnaires were developed 
and validated in a surgical population using 
in-laboratory polysomnography 23 and have subsequently 
been studied in a cardiovascular disease population. 25 
Our results are in agreement with these two earlier 
studies as regards the increased predictive value of 
STOP-BANG over STOP. In contrast to these earlier 
studies, however, we found sensitivities to be higher and 
specificities to be lower for both cut-points of AHI. We 
suggest that of the two AHI cut-points, >15 events/h is 
the more important, being diagnostic of at least moder- 
ate SDB and also an indication for CPAP treatment. At 
this cut-point, STOP and STOP-BANG performed with 
high sensitivities and negative predictive values 
(STOP-BANG being superior to STOP), indicating that 
these questionnaires are more useful in excluding sig- 
nificant SDB. This is further corroborated by the nega- 
tive likelihood ratios of <0.2 obtained for STOP and 
STOP-BANG that also indicate that these questionnaires 
are most useful in ruling out SDB. STOP-BANG may be 
of value in the primary care setting, perhaps if com- 
bined with type IV portable monitoring sleep studies, to 
determine requirement for sleep clinic review and more 
detailed polygraphy. 

At the AHI cut-point of >15, STOP-BANG had sensitiv- 
ity and NPV of 100%, and since this is the standard cut- 
point conventionally used to determine need for 
CPAP, 28 we suggest that the STOP-BANG Questionnaire 
is the preferred tool for prediction of SDB in the sleep 
clinic setting of those currently available. STOP-BANG, 
perhaps with modifications, merits further evaluation for 
the prediction of SDB in the sleep clinic population 
and, more importantly, its utility in prediction of clinical 
outcomes including treatment success should be 
assessed. 



The original STOP-BANG Questionnaire uses a cut- 
point of >3 to predict SDB. 23 However, in our study, we 
show that different cut-points can be selected depending 
on the preference to rule-in or rule-out SDB. A score of 
>3 had the highest overall accuracy and a sensitivity of 
0.93 for the AHI cut-point of >5, whereas a score of >6 
had the highest overall accuracy and a specificity of 0.78 
for the AHI cut-point of >15. Two other studies have 
examined the usefulness of different cut-points for the 
STOP-BANG score. 33 34 In the obese, a score of >3 was 
associated with a sensitivity of 0.90 for predicting an AHI 
>5, while a score of >6 had a specificity of 0.88 for pre- 
dicting an AHI >15 and similar results have been 
obtained in the morbidly obese 33 and in a surgical popu- 
lation. 34 Thus, in the sleep clinic setting where the 
ultimate goal is to identify patients requiring CPAP, a 
higher cut-point for STOP-BANG may be preferred, 
whereas in a primary care setting where the priority is 
not to miss disease, a lower cut-point may be chosen. 

The STOP-BANG Questionnaire is, however, still an 
imperfect tool for prediction of results on home polygra- 
phy. Accordingly, the secondary objective of our study 
was to identify variables for inclusion in a locally devel- 
oped composite score for future validation in the sleep 
clinic and potentially wider population. Univariate ana- 
lysis showed several significant, expected associations for 
both cut-points of AHI. Using multivariate analysis, neck 
circumference >17inch and the presence of witnessed 
apnoeas were independent predictors of SDB. This is 
not a novel finding, but it does support the robustness 
of our data. Particularly when SDB was defined by an 
AHI cut-point of >5, the regression model derived indi- 
cated a high probability of SDB of 0.94 if both factors 
were present. The STOP-BANG Questionnaire, of 
course, includes both these variables, and it is possible 
that adjustment of the inclusion variables, or their 
weighting, might improve its performance. In future 
work, we aim to validate a simple composite score based 
on these two variables in a modification of STOP-BANG, 
to determine utility for predicting sleep study data and 
outcomes with treatment. 
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Table 4 Sensitivities, specificities, PPV, NPV, LR+, LR- and overall accuracies of different cut-points of the STOP-BANG questionnaire for prediction of significant SDB 
as defined by: model A: AHI >5 events/h; model B: >15 events/h 



STOP-BANG Proportion Accuracy 



cut-point (/8) 


positive SB 


Sensitivity 


Specificity 


PPV 


NPV 


LR+ 


LR- 


(%; 


Model A 


















>2 


92/96 


0.99 (0.92 to 1 .00) 


0.12(0.03 to 0.32) 


0.77 (0.67 to 0.85) 


0.75 (0.19 to 0.99) 


1.13 


0.11 


77 


>3 


82/96 


0.93 (0.84 to 0.98) 


0.38 (0.19 to 0.59) 


0.82 (0.72 to 0.89) 


0.64 (0.35 to 0.87) 


1.49 


0.18 


79 


>4 


79/96 


0.90 (0.81 to 0.96) 


0.42 (0.22 to 0.63) 


0.82 (0.72 to 0.90) 


0.59 (0.33 to 0.82) 


1.55 


0.23 


78 


>5 


67/96 


0.81 (0.70 to 0.89) 


0.62 (0.41 to 0.81) 


0.87 (0.76 to 0.94) 


0.52 (0.32 to 0.71) 


2.15 


0.31 


76 


>6 


38/96 


0.46 (0.34 to 0.58) 


0.79 (0.58 to 0.93) 


0.87 (0.72 to 0.96) 


0.33 (0.21 to 0.46) 


2.20 


0.68 


54 


>7 


15/96 


0.18 (0.10 to 0.29) 


0.92 (0.73 to 0.99) 


0.87 (0.60 to 0.98) 


0.27 (0.18 to 0.38) 


2.17 


0.89 


36 


8 


5/96 


0.07 (0.02 to 0.15) 


1.00 (0.86 to 1.00) 


1 .00 (0.48 to 1 .00) 


0.26 (0.18 to 0.37) 




0.93 


30 


Model B 


















>2 


92/96 


1 .00 (0.91 to 1 .00) 


0.07 (0.02 to 0.18) 


0.45 (0.34 to 0.55) 


1 .00 (0.40 to 1 .00) 


1.08 


0 


47 


>3 


82/96 


1 .00 (0.91 to 1 .00) 


0.25 (0.15 to 0.39) 


0.50 (0.39 to 0.61) 


1 .00 (0.77 to 1 .00) 


1.34 


0 


57 


>4 


79/96 


1 .00 (0.91 to 1 .00) 


0.31 (0.19 to 0.45) 


0.52 (0.40 to 0.63) 


1.00 (0.80 to 1.00) 


1.45 


0 


60 


>5 


67/96 


0.93 (0.80 to 0.98) 


0.47 (0.34 to 0.61) 


0.57 (0.44 to 0.69) 


0.90 (0.73 to 0.98) 


1.76 


0.15 


67 


>6 


38/96 


0.63 (0.47 to 0.78) 


0.78 (0.65 to 0.88) 


0.68 (0.51 to 0.82) 


0.74 (0.61 to 0.85) 


2.91 


0.47 


72 


>7 


15/96 


0.22 (0.11 to 0.38) 


0.89 (0.78 to 0.96) 


0.60 (0.32 to 0.84) 


0.60 (0.49 to 0.71) 


2.01 


0.88 


60 


8 


5/96 


0.10(0.03 to 0.23) 


0.98 (0.90 to 1 .00) 


0.80 (0.28 to 0.99) 


0.59 (0.48 to 0.70) 


5.36 


0.92 


60 



Data presented with 95% CIs. 

AHI, apnoea hypopnoea index; LR+, likelihood ratios positive; LR-, likelihood ratios negative; NPV, negative predictive values; PPV, positive predictive values; SDB, sleep disordered breathing. 
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Table 5 Probabilities of SDB using a composite score 


based on neck circumference (>17 or 


<17 inch) and 




presence (1) or absence (0) of witnessed apnoeas derived 


from logistic regression models 








Witnessed 




Neck circumference (inch) 


apnoeas 




Model A 


0 


1 


<17 


0.47 


0.75 


>17 


0.83 


0.94 


Model B 


0 


1 


<17 


0.17 


0.40 


>17 


0.40 


0.69 


SDB defined by: A: AHI >5 events/h; B: >15 events/h. 



Ultimately, a predictive tool that can be utilised in 
primary care is the goal. Our results indicate low specifi- 
city of STOP-BANG, and therefore in its current form, if 
used in primary care to identify patients requiring refer- 
ral for further assessment, it is likely to result in a signifi- 
cant percentage of patients being referred unnecessarily 
(false positives). It is hoped that a modified 
STOP-BANG with improved specificity, while not com- 
promising sensitivity, may be developed that can be used 
safely in primary care for identification of patients 
requiring referral to sleep services. Of upmost import- 
ance too is the prediction of treatment outcome. 
Non-adherence to CPAP treatment occurs between 46% 
and 83%. 35 36 Prediction of poor adherence by 
STOP-BANG or other similar tools would allow greater 
attention to interventions to improve adherence in 
patients more likely to default from treatment. The 
authors are not aware of any studies investigating this 
question and future research should explore this import- 
ant issue. 

A possible limitation of our study was that SDB was 
characterised using home unattended limited sleep 
studies rather than in-hospital attended full polysomno- 
graphy The latter is considered the gold standard for 
diagnosis of SDB but is more expensive, less easily 
accessed and potentially unrepresentative with sleep in 
an unfamiliar environment. Home unattended and 
in-hospital attended sleep studies have previously been 
shown to produce similar results. 37 Accordingly, home 
testing with portable monitors is standard clinical prac- 
tice in the UK, and is now considered an acceptable 




0.00 020 O40 O60 O80 too 

1 -Specificity 



Model A • Model B 



Figure 1 Receiver operating characteristic (ROC) curves of 
logistic models for prediction of sleep disordered breathing 
(SDB) as defined by: model A: apnoea hypopnoea index 
(AHI) >5 events/h; predict SDB unless neck <17 inch and 
witnessed apnoeas absent; model B: AHI >15 events/h; 
predict SDB only if neck >17 inch and witnessed apnoeas 
present. 

method for diagnosis of OSA by the American Academy 
of Sleep Medicine. 28 The sample size limits the conclu- 
sions that can be drawn from multivariate analysis; 
however, this was a secondary objective of the current 
study. It is possible that variables predictive of SDB on 
univariate analysis in this cohort would have been identi- 
fied as independently predictive in multivariate models 
in a larger population. The results of this study allow us, 
and potentially others, to focus future work to validate 
more extensively the results obtained until now. We 
chose AHI cut-points of >5 and >15 to define significant 
SDB. This was based on the consensus guideline pro- 
duced by the Adult Obstructive Sleep Apnea Task Force 
of the American Academy of Sleep Medicine that states 
that diagnosis of OSA is based on a cut-point of >15 
events/h or >5 events/h with relevant symptoms, and 
that CPAP is indicated for treatment of moderate- 
to-severe OSA with >15 events/h. 28 Although the cut- 
point of >30 events/h is consistent with severe OSA, we 
suggest that this cut-point is less relevant clinically from 
a diagnostic perspective or from that of determining 
treatment. Finally, owing to the prospective design of 
our study, we cannot comment on the relative value of 
other tools developed for prediction of OSA such as the 



Table 6 Sensitivities, specificities, PPV, NPV and overall accuracies of logistic models for prediction of SDB as defined by: 
A: AHI >5 events/h; predict SDB unless neck <17 inch and witnessed apnoeas absent; B: AHI >15 events/h; predict SDB 
only if neck >17 inch and witnessed apnoeas present 



Model 


Sensitivity 


Specificity 


PPV NPV 


Accuracy (%) 


A 


0.84 (0.75 to 0.91) 


0.54 (0.34 to 0.72) 


0.85 (0.76 to 0.92) 0.52 (0.32 to 0.71 ) 


77 


B 


0.56 (0.41 to 0.70) 


0.80 (0.68 to 0.89) 


0.69 (0.53 to 0.82) 0.69 (0.57 to 0.79) 


69 



Data presented with 95% CIs. 

AHI, apnoea hypopnoea index; LR+, likelihood ratios positive; LR-, likelihood ratios negative; NPV, negative predictive values; PPV, positive 
predictive values; SDB, sleep disordered breathing. 
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Sleep Apnea Clinical Score and American Society of 
Anesthesiologists Checklist. 39 To compare their utility 
with that of the Berlin, STOP and STOP-BANG 
Questionnaires in the population referred to, the sleep 
service would require a further study. 

In conclusion, the Berlin Questionnaire was not useful 
in the prediction of SDB within our sleep clinic popula- 
tion. The STOP-BANG Questionnaire had superior pre- 
dictive performance to the STOP Questionnaire at both 
cut-points of AHI (>5 and >15). A STOP-BANG score of 
>3 had the highest overall accuracy and a sensitivity of 
0.93 for the prediction of an AHI >5, while a score of >6 
had the highest overall accuracy and a specificity of 0.78 
for the prediction of an AHI >15. Future work will valid- 
ate a composite score including neck circumference 
>17inch and the presence of witnessed apnoeas for the 
prediction of SDB in the sleep clinic referral population. 
An optimised composite score could then be evaluated in 
primary care and against treatment outcomes, with our 
overall aim being to provide required tools for use in the 
expanded and consolidated sleep services that are now 
necessary given the current obesity and OSA epidemics. 
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